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Simple structures: 
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Robots need to cooperate 

— Not large enough to operate entirely in parallel 
Robot precision is low 

Raw material is poor 

Robots need to overcome failure 
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Multiagent Learning System 
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Assumes agents are imperfect and low 
precision 


Adapts to agent failures 
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(Can be slow) 


Agent Learning 
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Policy 


Reward 
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Temporal Credit Assignment 


Temporal Credit Assignment Problem 
(RL) 


Structural Credit Assignment 
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¢ Can be difficult to assign credit through time 
and to the right agent. 


¢ Convergence possible through “team games” 
but very slow. 

¢ Reward shaping can improve prospects 
— Want shaped reward to improve “signal.” 
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Rover chooses function 
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from sensor inputs to 
Rover observes points of interest and control achon 
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Rover updates its population of 
mapping functions based on evaluation 


Shaped evaluation is used to take 
“noise” out of global evaluation 
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State of system Rover is evaluated based on 
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Will it Work for Planetary 
Co) aiaaeleintel ars 
¢ Is enough 
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possible? 
Can learning be 
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Will small rovers 
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Tensegrity Robots 
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Tensegrity Control Learning 


Tensegrity Construction 
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Collapsible and light 
weight 

Scalable 
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